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(14) (2) If a target object is a 
three-dimensional object, and has a depth and 
an uneven surface pattern, the appearance 

(area, shape, and the like) of the 1^1 
object changes in different directions. 

(15) (3) If a target object is not a 
perfectly rigid object (e.g., a man 
wearing clothing), the shape of the object 
changes at each time point. 

(15) (4) If a portion of a background and a 
portion o f a t arget object have 
the same QJBB or luminance, the same color or 
luminance portion of the target 
object is not detected as a changing area 
while the target object passes 

through the same color or luminance portion of 
the background, 

(17) In the states wherein corresponding 
changing areas are not necessarily 
detected at each time point as described 
above, since corresponding changing 
areas m ay not be p r e s e nt , m o v i n g vectors m ay 
not be obt a i ne d . T he r e f o r e , the 
block association processing scheme may not 
properly function. If the block 
association processing scheme fails or does 
not properly function as described 
above, serious problems are posed when it is 
applied to a monitoring system 
(display monitoring system; . 

(18) In order to solve the above -de scribed 
problems, a tracking means capable 
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(9 4) (4) In the above embodiments, changes 
a r e c;o n si cie r e d on ly i n t e rm 5 of 
brightness. However, a method of detecting 
changes on the basis of changes in 
^^SE or ^-^tu re may be simply used depending 
on an application. If it is 

known in advance that a target object has a 

specific color, a change can be 

reliably detected by detecting a change in 

color or by assembly! ng a plurality 

of change detections. In this case, depending 

on a target object, a change can 

be properly detected only by certain 

processing. In such a case, the method 

used in the change detection should be 

transferred to the tracking step so that 

tracking processing is also performed in 

consideration of the used method, thus 

improving the reliability of processing. 
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(95) (5) In the above embodiments 
sizes of changing areas are taken 
into consideration to determine which one of 
the areas is to be tracked. 
However, if a changing area is selected in 
consideration of information about 
the shapes of changing areas in addition to 
their sizes, a target can be more 
reliably selected. Since the contour of a 
still object tends to be mistaken 
for a changing portion due to the difference 
between the contour and the 

background, the following processing may be 

additionally performed: removing 

edges such as the contour mentioned above, or 
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unit . In this case, it serves as a module for ^| 
tracking an object and 
extracting its contour. 

(109) Modifications of the candidate 
extraction processing performed by the 
candidate extracting section 44 0 will be 
de sc ri bed below . 

(110) (1) Only information relating to the 
moving path of each tracking unit, 
such as position and speed information of each 
t r ac ki n g unit wi t hi n an im a ge , 
is used to the estimation function used for 
candidate extraction processing. 
However, feature amounts of, e.g., ^J^E anc * 
shape, obtained from the tracking 
area of each tracking unit may be added to the 
information. Assume that a 

plurality of tracking units are concurrently 
cracking body portions of an 

intruder in red clothing. If the process for 
determining the identity of the 
intruder is additionally performed upon 
extraction of color information from 
the tracking area of each tracking unit, a 
candidate can be easily extracted by 
associating the information from the tracking 
unit . 



( 1 11 ) { 2 ) Thee st. imat, i on f unct ion used for 

calculating the association 

strengths between the tracking units in 

candidate extraction processing may be 

replaced with the process for extracting a 

candidate for a moving object by 

using knowledge associated with the positions 
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associating the information from the tracking 
unit . 

(111) (2) The estimation function used for 
calculating the association 

strengths between the tracking units in 
candidate extraction processing may be 
replaced with the process for extracting a 
candidate for a moving object by 
using knowledge associated with the positions 
and speeds of tracking units, 

attribute values such as the QJ^Qs' and shapes 
of changing areas which are 
being tracked, and the preset shape and 
movement information of an intruder. 

(112) An example of this processing will be 
described below. Processing 

modules are prepared. Each module compares 
the respective information 

described above between two tracking units and 

converts the comparison result 

into numerical values indicating whether the 

compared information are close to 

each other (i.e., moving objects resemble each 

other or the same moving object 

is tracked) . Output, results from the 

respective processing modules may be 

simply added together. Alternatively, the 

priorities of the respective 

information are determined, and a weighted sum 
obtained by weighting in 

accordance with the priorities is used as an 
a s s o ci at i. o n st r e n gt h . For 

example, by using information associated with 
the shape of an intruder, the 
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processing. 

(113) (3) Each candidate list formed by the 

candidate extracting section 44 0 

need not be constituted by only a group of 

tracking units but may include the 

overall position information of the candidates 

and attribute values such as 

^J^Q anc * shape information obtained from 

areas to which the tracking units are 

assigned, In this case, feature extraction 

processing is performed in addition 

to candidate extraction processing so that 

when candidate are extracted by the 

candidate extraction processing, feature 

information can be simultaneously 

extracted from areas in an image in which the 

candidates exists. The extracted 

feature information is then added to the 

candidate information to form a 

candidate list. If additional attribute 

values are included in candidate data, 

association processing is facilitated by 

adding the process for determining the 

similarity of attribute values to the process 

for associating candidates in the 

result interpreting section 45Q. In addition, 

the reliability of the 

association processing result is increased. 

The feature extraction processing 

need not be included in the candidate 

extraction processing but may be 

performed parallel as independent processing 

so that the feature extraction 

processing can be sequentially performed in 

response to requests from the 
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